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Abstract 

In this paper we introduee a nonextensive quantum information theoretie measure 
whieh may be defined between any arbitrary number of density matriees, and we ana¬ 
lyze its fundamental properties in the speetral graph-theoretie framework. Unlike other 
entropie measures, the proposed quantum divergenee is symmetrie, matrix-eonvex, the- 
oretieally upper-bounded, and has the advantage of being generalizable to any arbitrary 
number of density matriees, with a possibility of assigning weights to these densities. 


1 Introduction 

In recent years, there has been a concerted research effort in statistical physics to explore the 
properties of the non-additive Tsallis entropy [1], leading to a statistical mechanics that satis¬ 
fies many of the properties of the standard theory. In the framework of quantum information 
theory, quantum Tsallis entropy defined in terms of a density matrix is a generalization of von 
Neumann entropy, and it has been applied successfully to the problems of separability and 
quantum entanglement [2]. A density matrix is used in quantum theory to describe the statis¬ 
tical state of a quantum system. Typical situations in which such a matrix is needed include: 



a quantum system in thermal equilibrium, nonequilibrium time-evolution that starts out of a 
mixed equilibrium state, and entanglement between two subsystems, where each individual 
system must be described by a density matrix even though the complete system may be in a 
pure state. 

Kulback-Liebler divergence, one of Shannon’s entropy-based measures, has been suc¬ 
cessfully used in many applications including statistical pattern recognition, neural networks, 
graph theory, and optoelectronic systems [3]. Recently, the quantum Kulback-Liebler diver¬ 
gence has been applied to the problems of measuring quantum entanglement and maximum 
entropy principle [4,5], and it has also been used to establish a proof of the second law of 
nonextensive quantum thermodynamics of small systems [6]. 

In this paper, a nonextensive quantum entropic divergence between density matrices is 
presented. We show that this divergence measure is symmetric, matrix-convex, theoretically 
upper-bounded, and quantifies efficiently the statistical dissimilarity between density matri¬ 
ces. We investigate some of the main theoretical properties of the proposed entropic diver¬ 
gence as well as their implications in the spectral graph theoretic framework. In particular 
we derive its upper bound, which is very useful for normalization purposes. 

2 Laplacian Density Matrix and Quantum Tsallis Entropy 

A graph M may be defined as a pair M = {V,£), where V = {vi,..., v^} is the set of 
vertices and £ = {cij} is the set of edges. Each edge Cij = [v^, v^] connects a pair of vertices 
{vj, Vj }. Two distinct vertices v*, Vj G V are adjacent or neighbors (written v* ~ Vj) if they 
are connected by an edge, i.e. etj e £. The neighborhood (also referred to as a ring) of a 
vertex Vj is the set v* = (v^ G V ; Vj ~ v^ }. The degree di of a vertex Vj is simply the 
cardinality of v*. 

The Laplacian matrix of M is given by L = D — A, where A = (a^) is the adjacency 
matrix between the vertices, that is an = 0 and = 1 if Vj ~ ; and D = diagjdj : Vj G 



V} is the degree matrix (diagonal matrix whose (i, i) entry is di). It is worth pointing out that 
the number of edges of M is given by \£\ = tr(D)/2 and that tr(A) = 0, where tr(-) denotes 
the trace (sum of diagonal elements) of a matrix. 

Spectral graph theory uses the spectra of matrices associated with the graph, such as the 
adjacency matrix or the Laplacian matrix, to provide information about the graph [7, 8]. It 
can be shown that the Laplacian matrix is symmetric and positive semidefinite. Therefore, the 
eigenvalues (spectrum) of L are nonnegative 0 = Ai < A2 < ... Am- Its first eigenvector is 
1 = (1,1,...,!)^ (an m-vector of ones), and all the remaining eigenvectors are orthogonal 
to 1. Moreover, the sum of the eigenvalues of L is equal to the volume of the graph, i.e. 
vol(M) = tr(D) = Er=i d. = TZi A. 

It follows from tr(L) = tr(D) — tr(A) = tr(D) that the following matrix 

^ tr(D) vol(M) ^ ^ 

is symmetric positive semidefinite with trace one. Therefore, p defines a density matrix 
which we refer to as Laplacian density matrix. Figure 1 depicts an example of a graph with 
1572 vertices and 4728 edges, representing a 3D mechanical part, and its (sparse) Laplacian 
density matrix. 
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Figure 1: 3D mesh (left) and its Laplacian density matrix (right). 





From (1), it can readily be shown that the eigenvalues of the Laplacian density matrix are 
given by 

^ . e [0,1], = 

tr(D) 

such that 0 = /xi < /i 2 < • • • /im and Y^^=i F-* = 1- Thus, the spectrum n = (/ii,..., /i^) 
of p is a nonnegative row vector such that p 1 = 1. Moreover, the eigenvectors of p are the 
same as the eigenvectors of the Laplacian matrix. 

The eigendecomposition of p may be written as an outer product expansion (sum of rank- 
one matrices) 

m 

P = Uiuf, (2) 

i=l 

where Uj denote the orthonormal eigenvectors associated to the eigenvalues pi. It is worth 
pointing out that in quantum physics, each eigenvector u* is a state, and that the density 
matrix is mixture state. Each state u* is associated with a rank-one matrix (also called dyad) 
Ujuf, which may be seen as a one-dimensional projection matrix which projects any vector 
onto direction Uj. Note that dyads have trace one: tr(ujuf) = tr(ufuj) = ||uj ||2 = 1, Vi = 
1,..., m. Furthermore, a density matrix may also be interpreted as a generalization of a finite 
probability distribution. That is, any density matrix can be decomposed into mixture of m 
orthogonal dyads, one for each eigenvector. Moreover, for any real-valued function (p defined 
on the interval [0,1], we have (p{p) = ^ (p{pi) u^uf and tr(99(p)) = YhLi 

It is well-known that Shannon entropy measures the uncertainty associated with a prob¬ 
ability distribution. Quantum states are described in a similar fashion, with density matrices 
replacing probability distributions. The von Neumann entropy of p is given by 

H{p) = - tr(p log p) = H{p,), (3) 

where H{p,) is Shannon entropy of the spectrum p. 

Let a G (0,1) U (1, cx)) be a positive entropic index. A generalization of von Neumann 
entropy is quantum Renyi entropy given by 

Ra{p) = -^logtr(p") = Ra{p), 

1 — a 


( 4 ) 



where Rait-i) is Renyi entropy of 

Another important generalization of von Neumann entropy is quantum Tsallis entropy 
given by 

“ l) = (5) 

where is Tsallis entropy of /i. 

We say that a function <h defined on a convex set S of density matrices is matrix-concave [9] 
if 

$(Ap + (1 - A)cr) > A$(p) + (1 - A)<f>(cr), (6) 

for all A G [0,1] and p,(T E S. Also, we say that <h is matrix-convex if —$ is matrix-concave. 

Proposition 1 Quantum Tsallis entropy is matrix-concave for a E (0,1) U (1, cx)). 

Proof: Let and p 2 be two Laplacian density matrices with spectra Pi and p ,2 respec¬ 
tively. The concavity of Tsallis entropy implies 


Hai^Pl + (1 — ^)P2) — + (1 — A)^2) 

> \Ha{Pi) -f (1 — \)Ha(p,2) 

= \H^{p,) + {l-\)H^{p2). 


for all A G [0,1]. 


Note that for a E (0,1], quantum Renyi and Tsallis entropies are both matrix-concave 
functions; and for a > 1 quantum Tsallis entropy is also matrix-concave, but quantum Renyi 
entropy is neither matrix-concave nor matrix-convex. It is worth pointing out that for a > 1, 
the function p°‘ is not matrix-convex [9], whereas the function tr(p“) is matrix-convex as 
shown in Proposition 1. Moreover, every matrix-convex (resp. matrix-concave) function is 
convex (resp. concave) whereas not every convex (resp. concave) function is matrix-convex 
(resp. matrix-concave). 



From the computational point of view, quantum Tsallis entropy has the advantage of being 
more practical than von Neumann entropy for large graphs. This is mainly due to the fact that 
the computation of von Neumann entropy requires the calculation of the matrix-logarithm 
which is prohibitively expensive for large density matrices. 

Quantum Tsallis entropy may also be written as Ha{p) = — tr^p" log^, pj, where log^ 
is the a-logarithm function defined as log„ (x) = (1 — a) — 1) for a; > 0. 

For all x, y > 0, the a-logarithm function satisfies the following property 

loga(a^l/) = loga X + logo 1/ + (« “ 1) log^ X log^ y. (7) 

If we consider that a physical system can be decomposed in two statistical independent sub¬ 
systems with probability distributions p and q, then using (7) it can be shown that the joint 
quantum Tsallis entropy is pseudo-additive 

P 2 ) = ^a(pi) + Hc,{p 2 ) + (1 - a)i7„(pi)iT«(p2), (8) 

whereas von Neumann and quantum Renyi entropies satisfy the additivity property, that is 

H{pi, P 2 ) = H{p^) + i7(p2), and i?„(pi, ps) = Ra{,Pi) + Ra{,p 2 )- 

The pseudo-additivity property implies that quantum Tsallis entropy has a nonextensive 
property for statistical independent systems, whereas von Neumann and quantum Renyi en¬ 
tropies have the extensive property (i.e. additivity). Also, standard thermodynamics is exten¬ 
sive because of the short-range nature of the interaction between subsystems of a composite 
system. In other words, when a system is composed of two statistically independent subsys¬ 
tems, then the von Neumann entropy of the composite system is just the sum of entropies of 
the individual systems, and hence the correlations between the subsystems are not accounted 
for. Quantum Tsallis entropy, however, does take into account these correlations due to its 
pseudo-additivity property. Furthermore, many objects in nature interact through long range 
interactions such as gravitational or unscreened Coulomb forces. Hence, the property of ad¬ 
ditivity is very often violated, and consequently the use of a nonextensive quantum entropy 
is more suitable for real-world applications. Figure 3 depicts quantum Tsallis entropy of a 



2x2 diagonal density matrix p = diag(p, 1 — p) with p G [0,1], for different values of the 
parameter a. As illustrated in Figure 3, the measure of uneertainty is at a minimum when von 
Neumann entropy is used, and for a > 1 it deereases as the parameter a inereases. Further, 
quantum Tsallis entropy attains a maximum uneertainty when its entropie index a is equal to 
zero. 



Figure 2: Basie arehiteeture of a CNN. 

Figure 3: Quantum Tsallis entropy Ha{p) of a 2 x 2 diagonal density matrix p = diag(p, 1 — 
p) withp G [0,1]. 


3 Quantum Jensen-Tsallis divergence 


Definition 1 Let p^,..., p^ be n Laplacian density matrices. The quantum Jensen-Tsallis 
divergence is defined as 


where uj 


D"(pi, 




i=i 


Pi - 


i=i 


Uj Ha 


(Pi 


(ui,U 2 ,... ,0Jn) Is a nonnegative weight row-vector such that uj 1 


1 . 


















Using the Jensen inequality and the concavity of quantum Tsallis entropy, it follows that 
the quantum Jensen-Tsallis divergence is nonnegative for a > 0. It is also symmetric and 
vanishes if and only if the Laplacian density matrices ..., are equal, for all a > 0. Note 
that the Jensen-Shannon divergence [11,12,14,15] is a limiting case of the Jensen-Tsallis 
divergence when a —)■ 1. Moreover, unlike other entropy-based divergence measures such 
as the quantum Kullback-Leibler divergence [10], the quantum Jensen-Tsallis divergence has 
the advantage of being symmetric and generalizable to any arbitrary number of Laplacian 
density matrices, with a possibility of assigning weights to these densities. 

3.1 Properties of the quantum Jensen-Tsallis divergence 

The following result establishes the matrix-convexity of the quantum Jensen-Tsallis diver¬ 
gence of a set of Laplacian density matrices. 

Proposition 2 For a G [1, 2], the quantum Jensen-Tsallis divergence D‘^ is jointly matrix- 
convex of its arguments. 

Proof: It can be easily shown that the quantum Jensen-Tsallis divergence may be expressed 
as 

(9) 

where the ..., are the corresponding spectra of the densities. Then the result follows 
as a consequence of the joint convexity of the Jensen-Tsallis divergence between the spec¬ 
tra [13]. ■ 


In the sequel, we will restrict a G [1,2], unless specified otherwise. In addition to its 
matrix-convexity property, the quantum Jensen-Tsallis divergence is an adapted measure of 
disparity among n Laplacian density matrices as shown in the next result. 



Proposition 3 The quantum Jensen-Tsallis divergence D‘^ achieves its maximum value when 
Pi,..., are degenerate matrices, i.e. Pj = Sj = diag(0,..., 1,..., 0) with the j-th 
diagonal element equal to 1 and 0 otherwise. 

Proof: The domain of the quantum Jensen-Tsallis divergenee is a eonvex polytope in 
whieh the vertiees are degenerate matriees. That is, the maximum value of the quantum 
Jensen-Tsallis divergenee oeeurs at one of the extreme points whieh are the degenerate ma¬ 
triees. ■ 


4 Performance bounds of the quantum Jensen-Tsallis di¬ 
vergence 


Proposition 4 The upper-bound of the quantum Jensen-Tsallis divergence is given by 




Proof: Sinee the quantum Jensen-Tsallis divergenee is a matrix-eonvex funetion of ..., 
it aehieves its maximum value when quantum Tsallis entropy of the cu-weighted average of 
degenerate matriees aehieves its maximum value as well. Therefore, 


\j=l 

= (diag(a;i,... 


1 — a 
= HJuj] 


i=i 



which completes the proof. 


Since Ha{u>) attains its maximum value when the weights are uniformly distributed (i.e. 
Ui = 1/n, Vi), it follows that a tight upper bound of the proposed quantum divergence is 
given by: ..., 1/n) = log„ n. 

5 Conclusions 

In this paper, we proposed a nonextensive information-theoretic divergence called quantum 
Jensen-Tsallis divergence, and we analyzed its main properties in the graph-theoretic setting. 
We showed that this divergence is symmetric, matrix-convex, theoretically upper-bounded, 
and has the advantage of being generalizable to any arbitrary number of density matrices, 
with a possibility of assigning weights to these densities. The proposed entropic measure 
is also very promising due to its simplicity and its potential applications which may include 
image registration and object recognition. 
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